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THE FORMAT AND PROCESSING OF INFORMATION 
IN THE SELECTION PROCESS 

Don Bauthues 

University of Washington 



The selection process depends upon the amount and kinds of information 
available. No less important in arriving at a selection decision is the 
format and processing of the information. The purpose of this paper is to 
discuss factors affecting the gathering, processing, and utilizing of informa- 
tion in teacher selection and to describe two independent variables in an experi- 
ment on teacher selection. More specifically, the discussion will focus on: 

(a) selection strategies, (b) validity of information, (c) some current practices 
of gathering and utilizing information, and (d) the experimental variables: 
number of documents and masking of information.* 

Selection Strategies 



The strategy for selection determines, to a large extent, the nature of 
the data gathering, information processing, and decision-making procedures 
used. Perhaps the first dimension of a selection strategy is its purpose. 

That is, what kind of statement will it lead to regarding the candidates’ rela- 
tive qualifications for a position. Will the strategy lead to an ordered rank- 
ing of all candidates, or an approval-reject list? Is it designed to select 
the ’’global" teacher, or certain types of teachers for specific situations? 

Is it specifically designed to select the best candidate, or merely an accept- 
able candidate? 

Another dimension of a selection strategy is the degree to which it 
relies on clinical or actuarial methods for assessing the applicants' 
qualifications. In their pure, theoretical form, the clinical and actuarial 
methods are on opposite ends of a continuum. The continuum consists of many 
methods that combine elements from both the clinical and actuarial approaches, 
but in differing degrees. 

"The clinical position," states Scott (1964), "is that each human organism 
presents a unique structure or pattern of behavior. This pattern consists of a 
dynamic combination of traits, abilities, motives, and values. To describe that 
unique individual adequately and to predict his behavior, the primary objective 
is to develop observational techniques that respect this uniqueness and lead to 



* This paper doe.s not discuss techniques, such as card sorting and electronic 
data processing, for storing and retrieving information on a large number of 
applicants for the purpose of identifying those that are qualified for a 
particular position. Rather, the concern is with the gathering, processing, 
and utilizing of information on an individual applicant to assess his qualifi- 
cations for a particular position. 
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under standing (an appeal to values) the individual.'* As it pertains to the 
selection of teachers i the clinical approach is based on the assumption that 
both the individuals and the Job are too complex to be adequately investi- 
gated and described by the statistical analysis of isolated variables. Basic 
to this assusq>tlon is the idea that there are many different teaching approaches 
and classroom interaction processes vhlch lead to comparable end results. 

Teaching behavior is considered to be an outgrowth of inner variables which can 
best be assessed by projective techniques and the personal interview. The 
result is usually a verbal description of the teacher's personality and a 
prediction of his future success in the position for which he is being consid- 
ered. The description and prediction are ucually general statements, expressto 
in terms of global teacher characteristics. 

The actuarial approach, in contrast, is based on the careful definition 
and measurement of performance outcomes, the measurement of molecular variables 
believed related to these outcomes, and empirical evidence which indicates the 
relationship between the predictor scores and criterion measures. Scott states 
that, "The Actuarial position accepts the fact that behavior may consist of a 
pattern of interrelated variables, but insists that behavioral dimensions are 
held in ccomon among individuals, although in varying degrees. 

An advantage of the actuarial approach, properly applied, is that it 
forces a careful search for different dimensions of teaching success. Once 
this has been done, predictor variables can be validated for the separate 
relatively Independent and differentially Important dimensions that will most 

likely be found. 

^ actuarial approach is not possible in situations where the number 

of meaningful relationships between predictor scores and criterion measures 
that have been validated by research is not sufficient for good decision making. 
Valid relationships between predictor scores and criterion measures are diffi- 
cult to establish if the job is new or if there is a small number of workers in 
the job category. However, aspects of the actuarial approach can usually be 
applied if desired. The greater number of validated predictor-criterion rela- 
tionships, the more actuarial the selection decision can be. If sufficient 
]^elatlonshlps have been established and if appropriate weights for the predic- 
tors have been determined for making an optimum selection decision, the decision 
can be completely actuarial. 

Another dimension of a selection strategy is the method used to incorpor- 
ate the many bits of information obtained on an applicant into a cumulative 
index or judgment of the applicant's qualifications. This can be done in a 
number of ways, five of which have been outlined by Toops (1945). These 
methods may be followed most precisely when the actuarial approach is applied. 
However, they may also be followed, in general, when using the cliifd^ihl approach. 

The methods are: 
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The ■i™n*t-<nn- of- characteristlc-scores method . By this method bits 
of Information are grouped according to the characteristic to which 
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It is believed they relate. A acore is thua derived for each 
characterlatlc being conaldered. The characterlatlc scorea are 
then added for a total acore. The groaa scorea may be aiumed, 
or the scorea may be weighted and then aummed. 

2, ihe successive hurdle method . The successive hurdle method Is 
especially useful If validity coefficients for thi» position have 
been determined. Then the successive hurdles can be applied 

In descending order of their validity until the desired number 
of applicants remain. 

3. The nreclse orofljA method . This method is used when certain levels 
of the characteristics and qualities evaluated are deemed essential 
for success on the Job, so that if the applicant does not have pre* 
clsely the skill -pattern, or profile, he should not be considered. 
Obviously, a favorable selection ratio Is a prerequisite for utili- 
zation of this method. A variation of this method Is the "thls-or- 
more" method, which Is essentially establishing cutting scores. 

4. The minimum divergence from desired profile method. By this method 
every candidate is compared with the ideal profile, and a measure of 
his disparity from that profile Is obtained. The top candidate Is 
the one with the minimum divergence. 

5, The predominant or outstanding merit method. Each candidate Is 
screened for predominant or outstanding characteristics or qualities. 
This method gives unusual weight In selection to those persons who 
possess unusual excellence In more than one characteristic. It Is 
the antithesis of the method of establishing minimal scores. It is 
assumed that particular strengths will compensate for other possible 
weaknesses. Although undoubtedly a good procedure if the require 
job behavior calls for unique strengths, this method can easily 
become a means of employing biases. 

After a plan for incorporating bits of Information into judgments of the 
applicants' qualifications has been determined, the next question is one of 
what Information should be sought. 

Information Validity and Utility 

Whatever the selection strategy used, it is the amount of relevant Informa- 
tion available which determines the completeness of the picture of the appli- 
cant's abilities and characteristics. Thus, the most pertinent question for 
the decision maker continually to ask is: what evidence shows best the 

tionshlp between certain measured or judged human qualities and different job 

behaviors? 
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A Isrge number of studlei have been conducted to ascertain the 
characteristics or combination of characteristics that are closely associated 
with teacher competency. It was hoped these characteristics could then be 
used to predict successful teaching. Review of the literature on this sub- 
ject reveals that in most cases the relationships between the teacher 
characteristics studied (characteristics such as intelligence, knowledge of 
subject matter, professional knowledge, culture, teaching attitude -- all 
as defined and measured by the various, studies) and measures of teacher 
effectiveness were non-existent, low, or showed considerable disparity 
(Fattu, 1963). The results of most studies indicate that none of these pre- 
dictors taken singly would be very suitable for selection purposes. However, 
one should not assume that this indicates a lack of applicability of actuarial 
methods to the teacher selection process. 

A major reason for the low correlations obtained in many studies has been 
low reliability in criteria used for teaching effectivenesa. If predictors and 
criteria are not measuring the same factors, the common variation is expected 
to be low. Another reason for obtaining low correlations is that the correla- 
tion coefficient yields a meaningful index of the relationship between only 
linear variables. High correlation coefficients will not be obtained between 
two non-linear variables unless the total range of the variables is divided 
into sections in which the variables are linear and separate coefficients are 
calculated for each section.* 

Broadly speaking, the validity of selection batteries for a single class 
of predictors may be limited by: (a) their making distinctions not relevant 

to the job, (b) their failure to make relevant distinctions, (c) unpredlcted 
changes that take place in the individual over time, (d) lack of reliability 
in judging the quality of work performance, and (e) unpredlcted differences 
occurring in the nature and conditions of work (Bransford, 1967). Ghlselli 
and Haire have reported research giving evidence that the validity coefficients 
of various selection tests for different criteria vary over time. They conclude 
that "the practice of using perfromance data obtai.ned during an initial period 
and letting it stand for ultimate or total performance completely Ignores the 
dynamic character of the criterion and important changes that are taking place 
in the worker's performance" (I960, p. 226). 

Elements of Current Practices 

In order to determine the nature of current teacher selection practices, 
structured interviews were conducted with personnel directors in twenty school 



* One approach to identifying subgroups of differentially predictable persons 
has been called conflgural scoring by Dunnette (1966) and Actuarial Pattern 
Analysis by Lykken and Rose (1963). For an example, consider the variables 
education and experience. Each of these two variables can be tested for its 
predictiveness. However, by the conflgural method each variable is sub-classi- 
fled. In this case, education could be classified into 2 groups (B.A.s and 
Masters) and years of experience into 3 groups (1-3, 4-9, ^nd 10 or more) tq 
from 6 subgroups. The idea is to subgroup a set of predictors such that each 
of the groups is relatively homogeneous in regard to the pattern of job behavior 
shown. Then separate predictions can be made for each group. 
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distrlcts. Questions were asked regarding the general selection procedure, 
the nature and relative importance of their criteria, and the Indivl ua s 
Involved in the selection process. While the overall procedure varied from 
district to district, there was much similarity. In all districts, the 
selection strategy followed a clinical approach. In nearly all cases 
information concerning the applicant was obtained from three basic swrces. 
the application form, the interview, and the credentials from the college 
placement office. In some cases additional information was obtained from 
references listed on the application form. There were important differences, 
however. The districts varied considerably in: (a) the number of 

involved in assessing the applicant’s qualifications, (^> the locus of deci- 
sion responsibility on whether or not an applicant would be hired, and 
(c) the relative weight of the criteria applying to the selection. 



Biographical Data 

Biographical information represented a large proportion of the informa- 
tion that was accumulated on each applicant. Biographical information is 
gathered with the belief that relevant past behaviors are good predictors of 
future performance. There is probably considerable merit in the use of bio- 
graphical information for prediction purposes. However, as Dunnette states, 

"it is difficult to know exactly how past behaviors relate to specific future 
behaviors that may be of interest. . . The nature and extent of the inf ora- 
tion attained differ from applicant to applicant; predictions must be based 
on varying knowledge with the usual result that they can be little more than 
vague impressions, subjective hunches, and intuitive feelings (1966, p. 65). 

How are biographical data reviewed for Job behavior predictions? The 
clinical approach is to assess the bits of information and project them into 
patterns of consistent behavior. On the basis of these patterns of past 
behavior. Judgments are made regarding the applicant's personality and charac- 
teristics, and subjective predictions are made as to how he will most likely 
react in future situations. The actuarial approach, which none of the districts 
used, is to first standardize the biographical items. The separate items are 
then empirically compared against defined Job behaviors. 

In practice ii: that biographical information is often used to 

determine whether the applicant passes the initial selection hurdles. For 
those who do, other means, especially the interview, are used to determine 

final selection. 

Interview 

The school personnel surveyed indicated that they rely heavily upon the 
interview, especially as a means of assessing personality. Many research 
studies have found the interview either unreliable, invalid or both. 
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Other studies have shown that it can be a useful predictor of behavior 
(Yonge, 1956). The value of the interview depends upon its purpose and 
form, and the skill of the Interviewer; unfortunately, in practice, the 
validity of the interview is too often assumed. 

References 

Professional references vary considerably in reliability and validity. 

A recommendation from a person very familiar with the applicant under cirejm- 
stances which test those behavlorc relevant to the Job may be highly valuable. 

But recommendations are often worthless, either non-dlscrlmlnatlng among 
viduals or misleading. Personal references requested by the district should 
be obtained on a standard form if there is Intent to validate them. Some 
practitioners and some writers on selection procedures believe that a telephone 
check is a better procedure than mailing reference forms. Their reasons seem 

logical. 

The Experiment 

In the teacher selection experiment which is the focus of this symposium, 
four Independent variables relating to Information format were manipulated. 

TWO of these variables Involved the utilization of information on written docu- 
ments. 

Documents 

One variable was the number of documents, and one level of this variable 
was multiple documents. Data gathering devices used by school districts were 
analyzed by format and the type of information they gathered. On the basis of 
this analysis, documents typical of those used by school districts were created 
for the experiment. At the same time, it was Intended that the documents rep- 
resent the most reasonable of current practices. To accomplish this the litera- 
ture was searched for empirical evidence, and opinions were solicited from an 

advisory committee. 

The multiple documents consisted of : (a) an application blank; (b) college 
placement credentials which Included general Information, a report on student 
teaching, a suoinary of coursework including grades, and letters of recommenda- 
tion from professors, supervising teachers, and principals; and (c) a confi- 
dential teacher reference form from a principal or superintendent. 

A second level of the number of documents variable was a single or sutomary 
document. It is relatively easy to construct a single document on which one can 
sutnoarize the information obtained on forms initiated by the district -- appli- 
cation blank, reference form, interview form — because the categories of 
information are standardized by the use of these same forms for all applicants. 
The difficulty lies in making a form on which one can appropriately summarize 
the information contained on the various forms initiated outside the district. 
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8uch as college placement credentials and letters of recommendation. In 
the different forms and letters a district receives there will be a great 
variation in subject content, characteristics described, and descriptive 
adjectives and phrases used. However, a logical analysis of the different 
kinds of information given and the various descriptive terms used indicates 
that many different means are being employed to describe the same qualities 
and characteristics, a conclusion supported by the research of Tupes and 
Chrlstal (1961) and Peres and Garcia (1962). Therefore, it seems reason- 
able that a single document can be constructed on which one can appropriately 
summarize nearly all relevant bits of information received on a candidate. 

A major guideline in creating the summary document was to minimize the 
information categories in nominal form and maximize those in scalar or rating 
form. Of the four areas on the form General Information, ^Background Data, 

Sumnary of College Work, and Evaluative Data — only in the ’’General Informa- 
tion” section are the data recorded in nominal form. In the other three sec- 
tions, information is recorded on a five column rating grid. 

In the section on "Evaluative Data" an applicant could be rated on 25 
characteristics pertaining to personal qualities and teaching behaviors. 
Information contained in the credentials, student teaching report, and letters 
of recommendation was assessed and recorded on this grid. A code consisting 
of both letters and colors was used so that the persons looking at the grid 
would know the source of the original evaluations. 

For a school district to use the summary form, it would, of course, have 
to define each characteristic or behavior item on the document. It would also 
have to establish a policy as to what constitutes a particular rating for a 
particular characteristic or behavior. Although initially it would be consider- 
able work, the required careful examination of hiring policies would most likely 

be very beneficial. 

Masking 

Another variable in the experiment was masking. The motive for masking 
was based on the belief that it is time consuming to study each bit of informa- 
tion; and since a person has difficulty assimilating large amounts of data, 
it may be better to direct attention to only those bits of Information that 
are most discriminating. There were three levels of masking: (a) none, 

(b) partial, and (c) considerable. With partial masking, all the average 
data was masked out. With considerable masking all non-exceptlonal data was 

masked out. 



* Eight facto^ analysis studies of ratings on personality characteristics 
have been summarized by Tupes and Christal (1961). The same five factors of 
typical behavior emerged from all studies. In a study of 625 letters of recom- 
mendation by Peres and Garcia (1962), it was found that applicants were not 
described in terms of observable behavior (i«e «9 critical incidents) but rather 
by adjectives or generalized trait names. The 715 adjectives found in the 
letters were reduced to 170 by personnel people. A factor analysis of these 
170 adjectives identified 5 factors much the same as those identified by Tupes 

and Christal. 
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Both the sumnary document and the multiple documents were masked* 
so it was necessary to provide for consistent masking of the Information 
on the two levels of documents. The sunnary document was masked first. For 
partial masking the central column on the rating grids was masked out, leav- 
ing two columns at each extreme. For considerable masking, only a single 
column at each extreme was left unmaskec’ . Masking on the multiple documents 
yti§ derived from the masking on the summary document by utilizing records o 
correspondent information made at the time of the Initial transfer of Informa- 
tion from the multiple documents to the single documents. 

The masking was done to determine the effect on decisions of allowing 
the decision maker to attend to only the more exceptional Information. In 
practice, school districts might develop different ways of providing the 
decision maker with only exceptional data. 

SUMMARY 

This paper has discussed factors In the acquiring, processing, and 
utilizing of Information In teacher selection. A major factor In determining 
what Information will be gathered and how It will be utilized Is the selection 
strategy. An Important variation In selection strategies Is the degree to 
which they follow the clinical or actuarial approach. Although the clinical 
approach Is easy to apply and there Is some evidence that It can be Improved 
by training. It would seem that there Is a definite limit to Its lmprov«ent 
possibilities. On the other hand, the actuarial approach, although it has 
not been well developed and Is more difficult to establish, appears to have 
greater potential. It Is the current practice to follow the clinical approach 
with great weight given to the Interview. 

Two variables In a teacher selection experiment were described. These 
variables were number of documents and masking of Information. These variables 
appear to be relevant to a number of facets of selection decision making. 
Including amount of time It takes to make the decision and effectiveness In 
utilizing Information. 
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